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by 
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ABSTRACT 

Let  x  be  a  random  vector  in  ]Rq  and  M  =  n-1 
n  n 

I  x.x. '  be  an  estimator  of  M  =  Exx'  with  spectral 

1  1  1 

form  ZAjPj.  An  expository  account  is  given  of  the 
estimation  of  A  ^  and  Pj  from  the  eigenvalues  and 
and  vectors  of  M  when  n  is  large.  This  includes 
a  derivation  of  the  basic  formulae  using  a  complex 
variable  method  in  the  book  by  Kato  (1980)  and  a 
contrasting  matrix  method.  Several  extensions  are 
indicated . 


ASYMPTOTIC  SPECTRAL  ANALYSIS  OF  CROSS-PRODUCT  MATRICES 


6.  S.  Watson 
Princeton  University 

1.  ^Introduction 

T.  W.  Anderson  (1963)  derived  die  asymptotic  distribution  of  the 
eigenvalues  and  vectors  of  tbs  covariance  matrix  of  a  sample  from  a 
Gaussian  distribution.  Davis  (1977)  took  his  basic  method  and  used 
it  to  get  some  results  for  the  non-Geusslan  case.  The  non-Gaussian 
case  is  of  Interest  either  because  one  wants  to  study  the  sensitivity 
of  methods  to  deviations  from  Gauss lenity  -  see  e.g.  Muirhead  (1982) 

-  or  because  one  has  to  deal  with  other  distributions.  For  ezsaple 
the  distribution  of  the  random  vector  might  be  entirely  restricted 
to  soma  manifold  eobedded  la  Bq  like  the  surface  of  the  unit 
sphere  or  an  hyperboloid  of  rotation ;  the  cases  of  interest  to  us. 


Kim  (1978)  at  the  suggestion  of  R.  J.  W.  Sarah,  used  results 
from  the  book  by  Rato  (1976,  1960)  on  tha  perturbation  theory  of 
linear  operators  to  find  tha  asymptotic  distribution  of  the  eigen¬ 
values  of  the  matrix  Mn  ■  n”1  £  W*  «h*r*  the  x^  0  are  Independently 
drawn  from  a  certain  distribution  on  tha  surface  6  of  the  unit 
sphere  la  .  Tyler  (1979,  1981)  also  used  Rato's  method  to  get 
results  in  classical  sultlvarlats  analysis.  But  the  technique  is  not 
well-known,  nor  immediately  evident  from  Rato's  book. 


Sato's  method  calls  upon  Cauchy's  Theorem  In  Complex  Variable 
Theory.  Specifically  consider  the  lategrsl  of  (s  -  *q)p  anti¬ 
clockwise  around  a  simple  closed  curve  C  in  the  complex  plane  which 
does  not  go  through  *q. 

|  (s  -  i0)p  ds 
C 

where  p  is  an  Integer.  Unless  p  -  -1,  it  is  always  saro.  When 
p  -  -1,  it  is  aero  if  Zq  Is  outside  C  and  2*i  where  Xq  Is  inside  C. 

The  techniques  and  formulae  below  have  many  possible  applications 
Some  are  given  In  Watson  (1982a)  but  most  remain  to  be  exploited.  In 
the  next  section  Sato's  method  is  explained  for  symmetric  non-random 
matrices  and  then  applied  in  Section  3  to  covariance  matrices. 


The  key  formulae  in  Section  2  and  the  results  of  Section  3  have 
of  course  been  obtained  before  by  direct  matrix  methods  - 

-  though  they  sre  hard  to  justify.  The  Sato  method  not 
only  gives  a  better  insight  but  is  easier  to  do  and  to  extend,  e.g. 
to  provide  asymptotic  expansions. 

2.  The  key  to  Sato 

|f  Tq  and  are  real  sjBetrlc  q  *  q  matrices  sad  x  is  a  small 
real  number 

T(x)  -  To  +  kTi  (2.1) 


earn  be  thought  of  as  a  linear  perturbation  of  T0.  Let  the  spectral 


r •presentation  of  the  matrix  bo 

*0*f  Ajpj  *  r  £*  (2*2) 

where 

A^#  ...,  Ar  ore  dlstlnet  reel  numbers, 

V  m  V  'A  ’  Vr 

r 

rank  ?i  •  trace  pj  *  J  “  « 

Thus  la  an  eigenvalue  of  Tq  dtet  la  repeated  times.  The 
Invariant  aubapace  associated  with  A^  has  dimension  and  Pj 
projects  orthogonally  onto  whose  direct  sum  Is  3R**. 

The  matrix  T(x)  may  have  q  distinct  eigenvalues  but  me  mould 
expect  these  to  fall  Into  r  dusters  about  A^,  ...,Xr  and  to  condense 
on  A1#  ...»  Af  as  x  -*>  0.  Equally  the  eigenvectors  of  T(x)  should 
lead  us  to  the  eigen  subspaces  Vj  as  x  0.  To  show  how  this 
happens,  define  the  resolvent  of  T0*  VC)  “ 

«0(O  -  (Tq  -  dq)“X  (2.4) 

where  C  Is  a  complex  nianber.  By  (2.2)  we  may  write 

IqU)  •  |  (A^  -  (2.5) 

Observe  that  Tq  and  Rq(C)  cosmut e. 


Zf  C  la  any  contour  In  the  complex  plane  which  does  not  go 
through  any  A^ ,  which  are  points  on  the  real  axis,  Cauchy's  Theorem 
end  (2.5)  imply  that 


where  the  sue  la  over  the  projectors  Pj  associated  with  eigenvalues  Xj 
Inside  C.  The  Integral  of  a  matrix  Is  the  matrix  of  Integrals.  Similarly 


(2.7) 


jfe  lc  W«4‘  *  £  ‘j'j 

V*  observe  chat  the  trace  of  (2.6)  gives  the  sub  of  the  dimensions 
of  the  eigen  subspaces  associated  with  X^  within  C.  Similarly  the 
trace  of  (2.7)  gives  the  sui  of  the  eigen  values  (times  their 
multiplicities)  within  C. 

Ve  now  consider  the  resolvent  of  T(x). 

1(*,C)  -  (T(x)  -  cy"1  -  Bq(C)(I^  +  xTjRqU))”1  (2.8) 

Zf  we  apply  the  results  of  die  previous  paragraph  to  ft(x,c),  we  will 
get  information  about  the  eigen  values  X(T(x))  and  projectors  P(T(x)), 
of  T(x).  As  x  -*■  0,  we  would  expect  the  values  of  X(T(x))  to  condense 
on  the  eigen  values  X^  of  Tq 

To  obtain  the  required  formulae,  we  need  to  expand  (2.8)  as  a 
power  series.  For  a  q  *  q  matrix  A, 

(I  +  xA)"1  -  I  -  xA .+  x2A2  -...  (2.9) 

9  9 

where  the  series  is  absolutely  convergent  provided  |x|  [| A  (|  <  1, 
where  ||  A  ||  is  a  norm  of  A.  Thus  we  can  say  that  for  x  sufficiently 

small, 

(I  «►  xA)"1  -  I  -  xA  +  0(x2)  .  (2.10) 

9  9 

Applying  (2.10)  to  (2.6),  we  have,  as  |x|  -*■  0, 

l(x,0  -  »q(0  -  x  1l0(c)  +  0(x2). 

Consider' now  the  analogue  of  (2.6)  when  is  a  contour  which 
encloses  only  the  eigen  value  X^.  Then 


(2.11) 


-  5  - 


iM «*•«<“  ■  v'>d‘tsLv')w'><' 


+  oc*2) 


(2.12) 


The  first  term  on  the  right  hand  side  (r.h.s.)  of  (2.12)  is  . 
To  find  the  second  term,  ve  observe  that,  if  ve  use  (2.5)  twice. 


r  r 


PkVl 


VO  WO  "  £  i  7 


r  PkTlpk 

•  £ 


(PkVi + 


krt  (\-C)  k<i 


ri  T  r»Airk/  l  l 

-  (2*13) 


The  contour  integral  of  the  first  tern  on  the  r.h.s.  of  (2.13)  is  sero. 
Ve  get  contributions  from  the  second  term  when  k  or  1  equal  j  end  they 
add  to  the  synnetrlc  matrix 
Pt-T-P.  +  P.T.P. 


z  m 

Wj 


‘jTk 


(2.14) 


Observe,  for  later  use,  that  this  matrix  has  a  sero  trace  because 
PjP^  is  null.  Thus 

1  f  VlP1^1^1Pk  2 

&  J  «*.<>«  -  v*  ^  y.  y  +  »<*  )  «•»> 

is  the  analogue  of  (2.6). 

The  analogue  of  (2.7)  is  obtained  by  integrating  T(x)R(x,c)  which 
may,  using  (2.1)  and  (2.11),  bs  written  as 

T(x)!(x,0  -  TqRqU)  +  x(Tj*0(O  -  T^OT^C))  +  0(x2).  (2.16) 

The  Integral  of  the  first  tarm  on  the  r.h.s.  of  (2.16)  is  that  in  (2.7). 


lb  find  the  second  end  third  tens  we  note  thet 


W° 


r 

z 

k-1 


tvt>*Vk 


» 


W'>W‘> 


J  VkVk 

k-1 


.  VkVt^iVA.  i  i  , 
k<i  *At“V  V*c  Ai“c 


where  we  heve  used  (2.2)  end  (2.13).  Thus  we  find  thet 


(2. 


(2. 


T(x)R(x,c)d( 


l.P.4x(T.P4  +  E 
J  J  A  J  ^ j 


WiWiVk, 

1  -  Ik 


+  0(x2)  . 


(2. 


Observe  thet  the  trsce  of  the  second  ten  In  the  coefficient  of  x 
Is  sero.  (2.19)  Is  the  enslogue  of  (2.7). 


In  the  eppllcetlons  we  heve  In  wind  T(x)  will  heve  q  distinct 

elgenvelues  ^(x) ,  ...»  A^(x)  end  (orthonormsl)  eigenvectors 

▼.(x),  ...t  v  (x)  so  thet 
l  9 


T(x) 


Z  l1(x)vi(x)vi(x)  * 


(2. 


le  the  spectrel  fon  for  T(x).  By  using  the  reesonlng  thet  led  to 
(2.6)  end  (2.7)  we  aey  then  eveluete  the  l.h.s.  a  of  (2.15)  end  (2.19) 


yjj  T(x)R(x,c)dc  ■  Z  AjGOv^xW^x)* 

where  both  sums  sre  over  1  such  that  A^(x)  ere  points  Inside  . 
the  contour  C^. 

Since  trace  v^CxJv^Cx) '  ■  v^'  (x)v^(x)  ■  1,  taking  the 

trace  of  both  sides  of  (2.15)  sad  using  (2.21)  yields 

#  A^(x)  Inside  ■  q^  +  O(x^) 

for  any  contour  Cj  enclosing  A^.  As  x  «►  0,  one  could  use  s. _ ier 

end  smaller  contours.  Hence  as  x  -»  0,  the  eigenvalues  of  T(x)  form 
clusters  of  q^  roots  about  A^  (j  ■  1,  ...»  r)  which  condense  upon  A 
If  we  do  not  take  the  trace  of  (2.15)  and  write 


A1(x)cCj 


then  (2.15)  may  be  written 


1*.T,P.4P .  T.  P. 


i  m  P  +  x  X  >TJ  {  +  °<-2> 

1  1  WJ  v"k 


Taking  the  trace  of  (2.19)  yields 


Z  A^(x)  within  Cj  ■  q^Aj  ♦  x  trace  +  0(xZ) 


so  dividing  through  by  q^  and  calling  the  l.h.s.  A^ ,  the  arithmetic 


.th 


of  the  1  cluster,  we  have 


-  8  - 


Tj  -  Aj  +  ^  trace  +  0(x2) 


(2.27) 


Tha  formulae  (2.25)  and  (2.27)  ara  Ideal  for  atatletlcal  applic¬ 
ations,  aa  will  be  seen  In  the  next  section.  Ve  close  this  section 
.by  observing  that  there  is  no  problem  except  complexity  in  getting 
higher  order  approximations  -  one  merely  takes  higher  order  terms 
in  (2.10).  For  example,  the  coefficient  of  x2  in  RCx^^  )  is  RqTjRqTjRq 
so  using  (2.5)  snd  partial  fraction  expansions  the  contour  Integral 
may  be  evaluated  to  give  a  lengthy  formula.  One  then  finds  that 
(2.23)  may  be  improved  to 


#  Aj(x)  inside  Cj  «  q^  +  0(x3) 


(2.28) 


In  Watson  (1982a)  explicit  results  are  given  when  r  =  2. 


3.  large  sample  theory  of  symmetric  cross-product  matrices 

Let  x  be  a  random  vector  la  IR4  with  components  x2,  x2,  . . ,  xq 
and  suppose  that  Ex^x^x1  exists  for  all  I,  J ,  k,  1  «  1,  . . ,  q. 

Let  x(  denote  the  transpose  of  x.  Call  Exx*  ■  E[x*x^]  ■  H,  a  symm¬ 
etric  q  x  q  matrix  with  spectral  form 


M  -  I  A.P. 
1  3  3 


(3.1) 


If  x^«  **•  xn  independent  copies  of  x,  define 
-1  n 

M_  -  a  A  I  x.x* 


(3.2) 


Then  -*■  M  by.  the  law  of  large  sabers  and  by  tha  multivariate 
central  limit  theorem 


n1/2(l!  -  M)  4  c. 


(3.3) 


The  q(q+l)/2  functionally  Independent  elements  of  the  symmetric 
natrlx  G  ere  jointly  Gaussian  with  aero  scans  and  a  covariance 


matrix  V  whose  elements  are 

1  iVA1  -  E(xV)E(aV),  i  <  j,  k  <  i.  (3.4: 

To  use  the  results  of  Section  2,  we  say  write 

M  ■  M  +  n“1/2  (n1/2(M..  -  M)>  (3.5] 

n  n 

instead  of 

T(x)  -  TQ  +  x  Tj 

-1/2 

From  (3.3),  corresponds  to  G,  x  to  n  ,  and  M  to  TQ.  Provided 

no  Aj  in  (3.1)  is  xero,  the  natrlx  Mn  will,  with  probability  one, 

have  distinct  eigenvalues  -  Okaaoto  (1973).  If  say  A1  •  0,  ECP^x)  (P-jX) ' 

2 

is  a  natrlx  of  zeros  so  that,  taking  the  trace,  E  ||FjX  ||  •  0.  Thus 

F.x  is  a  null  vector  and  will  have  q.  zero  roots  and  the  data  will 
1  n  ’1 

determine  the  eigen  subspace  exactly.  This  case  has  little  interest 
so  we  assume  that  all  the  Aj  >  0. 

The  natrlx  Mn  will  be  used  to  estimate  the  A^  and  Pj,  J»l,  ...,  r. 
Combining  (3.5)  with  (2.24),  (2.25)  and  (2.27),  we  have  the  key  results: 

for  j  m  1,  ...,  r. 


V*1  ♦  FiCFk 

*j  *  \ 


(3.6] 


n1/2  (A,  -  A.) 


—  trace  GP . 


(3.7) 


®  m 

The  r.h.s.  of  (3.6)  and  (3.7)  ara  llnaar  In  the  Gauaaian 
matrix  6  ao  that  tha  l.h.a.  hava  asymptotically  Gauaaian  dlstrlb~ 
utlona  with  aero  naans  and  variances  and  covariances  that  depend 
upon  tha  covariance  matrix  V  of  G. 

(3.7)  is  univariate  and  so  easy  to  understand,  e.g.  it  leads  to 
a  normal  confidence  interval  for  A^,  although  we  will  see  that  one 
will  do  better  with  a  transformation.  (3.6)  describes  the  difference 
between  estimated  and  true  projectors  and  needs  further  almplification. 
Using  the  Euclidean  aatrlx  norm  (  ||a||  ■  trace  M'), 


l|P4  “  *4  II2 


Z  trace  P.GP.G 

. .  - . J — — 

k^j  (A.  -  Ak)2 


(3.8) 


Again,  one  might  examine  the  different  effects  of  P^  and  Pj  on 
vectors.  For  example,  if  v  e  Vy 


n1/2(PjV  -  PjV) 


I 

tfj 


P.Ov 


(3.9) 


ao 


"  II Y  - 


1 2  d 


I 

ta*j 


v'GP^Gv 


(3.10) 


More  fundamentally  if  Vj  is  the  aubspace  onto  which  P^  projects, 
will  be  "doee"  to  if  coe  f  -  v'v  is  always  large  when  v  c  Vj 
and  v  c  || v  ||  *  1,  ||v  |]  -  1.  Thus  we  should  seek  the  stationary 

values  of  (PjU)»(P^w),  given  IjPjU  |[  -  ||PjW ||  -  1,  i.e.,  we  should 


consider 


where  6  and  t  ara  Lagranglaa  multipliers.  Hanca 


Vju  -  *y  -  °  •  \ 

-  ^PjW  -  0  ,  * 

ao  that 

6  -  ♦  -  stationary  value  of  (P^u)  *  (PjW) 

"  C,  say  . 

Banco  the  equations  (3.11)  will  only  have  a  aolutlon  If 


*3*3 

PJ  *3 

•**3 

•  0 


Thla  aquation  for  C  way  ha  reduced  to 


pj  V*  - 


which  haa  q^  non-rero  roots  .  If ,  however,  (3.6)  la  used,  one 


flnda  eventually  that  all  the  are  unity.  Watson  (1982a)  deals 


with  the  case  where  r  ■  2  and  shows  t  by  taking  the  next  tern  In  the 

2. 


expansions  In  Section  2,  that  n(l  -  )  have  asymptotic  distrib¬ 

utions.  It  is  conjectured  that  for  any  r  the  asymptotic  joint 


distribution  of  n(l-C, ) ,  ...»  n(l  -  C  )  is  the  joint  distribution 

1  ^ 
of  the  non-sero  eigenvalues  of 


Sob*  of  th*  above  result*  become  easier  to  understand  if  ve 
write,  since  •  P^  +  ...  +  ?r, 

»  Pj*,  x  -  ♦  ...  ♦  yr 

One  of  the  reasons  results  becooe  slapler  for  the  Gaussian  is 
that  there  jr^ . yr  are  independent.  Since  En'  ■  M  ■  X^Pj 

*v»’  •  "•  *  * k-  *vj’  *  xi  ?j  i 

*yJl,yk  •  o,  (i¥k).iyj*yj  • 

Thus  (3.7)  asy  be  rewritten  as 


so  that  by  (3.16)  and  the  Central  Limit  Theorem 

JL  n1,Z  (Tj  -  Xj) - *  C1(0,  vsr(y^'y^)  q“2  ) 

where  G  (y,Z)  stands  for  the  Gaussian  distribution  in  q  dimensions 
with  wean  vector  u  and  covariance  matrix  f.  Similarly  (3.6)  can 


be  written  as 


If  JLx 


’i  Vj1 


G^(0,M) ,  7^,  yj,  ....  j -  ere  Independent  and 


ao  that  var(yjyj) 


■  X|2qj.  Than  (3.18)  raada: 


<L  n1/2  (Tj  -  Xj)  - >  Cx(  0,  2A2/qj) 

Bancc 

JLn1/2  (log  (Tj/A^)  -  1)  - >  GjW,  2/qj)  (3.2( 

giving  the  variance  atablllxing  tranaforaatlon.  Moreover  In  thla 

Geueelan  caae  the  n2^2  (T^  -  A^)  or  n2^2  (log(T^/Aj)  -  1)  are 

asyoptotically  Independent,  a  simplifying  result  which  la  not  true 

In  general.  Coder  no  circumstances  could  It  be  expected  that  the 

r 

P.  would  be  Independent  since  7  f.  •  I  . 

3  J-l  J  q 

With  this  Introduction,  the  compact  paper  by  Tyler  (1981)  nay 

be  read  for  sore  details  on  Pj.  Be  also  gives  tests. 

special  case  of  r  -  2  and  distributions  restricted  to  fi  ,  Batson  (1982a) 
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If  an  additional  assumption  is  aede  that  the 


distribution  of  x  depends  only  upon  ||y^{|,  ...»  ||yTll  more  results 
any  be  derived  -  see  Batson  1982b). 


4.  Direct  approach  to  larae  saaple  theory  of  cross-product  aatrlces. 


The  eigenvalues  of  are  the  roots  A  of 


-  Ail  ■  |M  -  ai  tJ  -  0 


where,  as  la  Section  3,  M  ■  Z  A^P^ ,  T^  ■  ^a(Mn  -  M).  Suppose  ortho* 
normal  eigenvectors  are  selected  to  span  each  of  tha  Invariant 


•nbipuu  Vj  and  arranged  as  eoltam  vectors  to  fora  a  q  *  q 
orthogonal  matrix  H.  Let  the  flrat  columns  correspond  to  V^# 
the  next  q2  coluana  to  Vj,  etc.,  and  write  It  In  partitioned  form 

B  ■  [Hj,  • • • ,  B^J 

Then  since  H*H  ■  HH'  ■  1  *  we  have 

H 

Kb  *  «*»>  •  Kb  ■  \ » 

x,  * 

“  1»  •••*  T  | 


HjH^  ♦  ...  +  HrHj 


B.Hi 


B'MH  -  D(A.I  )  , 

J  qJ 

a  matrix  partitioned  ao  all  r*  auhmatrlces  are  aero  except  for  the 
multiples  of  Identity  matrices  on  the  diagonal. 

If  B  la  applied  to  (4.1),  It  takes  the  partitioned  form. 

Since  n  ■*  “,  we  seek  the  0(1)  and  0(n~^)  terms  only  In  the 
expansion  of  (4.5).  Applying  the  formula 


A  C 


|a|  |®  -  ia"xc| 
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when  A  Is  the  leading  subnatrlx  of  (4.5) ,  it  Is  seen  that  BA*’1C 
is  0(n”2)  and  so  negligible.  Hence  ve  nay  repeat  the  procedure  to 
find  that  equation  (4.5)  and  hence  (4.1)  is*  to  this  order 


(4.6) 


This  shows  that  the  eigenvalues  of  H&v  for  large  n,  form  clusters 

about  the  r  distinct  roots  Xj  of  M.  Expanding  the  J**1  factor  in 
-1/2 

(4.6)  to  0(n  ),  we  only  seed  the  product  of  the  diagonal  terns 

and  find  the  equation 


q1  -1/2  tpace  H1T1H1 
(Xj  -  X)  J(1  +  n  1/2 - jpff'  1  -  0 


(4.7) 


Since  trace  «  trace  »  trace  P^T^  by  (4.3)  the 

q^  roots  of  (4.7)  tend  to  Xj  as  n  *►  •  and  the  leading  tens  of  the 
polynomial  (degree  q.)  equation  for  X  are 


Xq  -  {qX^  ♦  n_1/2  trace  + 


...  ■  0 


(4.6) 


so  that  If  the  roots  of  this  equation  are  denoted  by  X, 


IX  -  qXj  +  n“*^2  trace  P^T^  , 


(4.9) 


as  we  found  In  (3.27).  .  But  one 


t  expect  to  obtain  the  roots 


In  tfhe  cluster  for  X^  from  (4.7)  (it  gives  then  to  he  X^  (q-1  tines)  • 


X|  4-  n  '  trace  P^T^  (once))  because  when  X  is  within  n  of  X 

.  -1/2 

all  the  terns  In  the  matrix  la  (4.6)  are  of  order  n  .  However 
(4.8)  does  give  the  correct  coefficient  for  Xq“2  in  (4.6). 


Sine*  the  eigenvalues  of  M  will  in  general  he  distinct,  the 
approximations  node  above  are  inadequate  to  dlscuas  e.g.  the  joint 
dlatrlbutlon  of  the  eigenvalues  in  a  cluster. 

The  following  direct  derivation  of  tha  analogue  of  (2.25) 
or  (3.6)  is  harder  to  justify.  Write 


P j  -  P j  +  n‘1/2A.  A  -  a 1/2(Pj  -  ?J) 
and,  because  the  roots  in  the  cluster  are  vlthln  n”1  of  Aj,  set 

Vj  • 

l.e. 

(M  +  n"1,2TJ)  (Pj  ♦  n“1/2A)  -  (A^  ♦  n'1/2fi)  (Pj  +  n“1/2A 
-1/2 

so  that  the  terns  in  n  yield  the  equation 

TjPj  +  MA  -  AjA  4  6Pj 
or 

(M  -  A^I)A  -  -TjPj  ♦  «Pj 

But  M  -  AjI  •  (A^  -  A^)?k  eo  that  «e  could  replace  A  by 

A  -  PjX  and  still  satisfy  (4.12).  Thus  (4.12)  is  solved  by 
ssiltlplylag  (4.12)  by  1(1^  -  A^)~1Pk  and  adding  PjX  so  that 

4  ’  -  Wf!  ♦  v 


lovevar,  fron  (4.10)  «e  see  that  A  nust  be  syanetrle  and  this 
determines  X.  Thus 
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-  v  - 


(4. 


which  Is  the  desired  result.  However,  without  the  re  stilts  of 
Section  3,  (4.10)  end  (4.11)  ere  merely  Intuitions. 


5.  Additions!  Remarks 

(1)  Suppose  (z^,  jj)  for  1*1,  ...»  n  srs  Independent  copies 
of  s  pair  of  rsndow  vectors  (z,  y),  z  e  St*,  y  c  3RP.  Define  the 
estimator  of  H  -  Ezy' 


and  assume  that  the  Central  Limit  Theorem  holds  so  that 


n1/2  (H  -  H)  -i-»  F  (5. 

n 

One  may  wish  to  estimate  the  singular  values  of  H  so  one  would  find 
the  non-aero  eigenvalues  of  MM*  or  I'M  whichever  Is  the  smaller. 
But  using  (5.2), 

■  'M  %  H*H  +  n”1^2(F,H  ♦  H'F)  (5. 

B  B 

so  that  the  previous  theory  Is  applicable. 


(11)  Suppose  that  z^,  ...,  Is  s  sample  from  one  q  dimensional 
distribution’,  z^*,  ...,  z^*  a  sample  from  another  distribution  In  JR** 
and  1st  ■  n'^Iz^z^',  1^*  •  m”2  Iz^*,  z^**.  Than  we  often  need 
to  study  the  solutions  of 


°*n  “  *V)t  "  0 


(5 


Anderson  (1958)  gives  examples  and  cells  X  end  v  the  eigen 

values  and  vectors  of  M_  in  the  metric  of  M  .  To  study  them  in 

n  s 

large  samples  we  suppose  that  the  Central  Limit  Theorem  applies 
in  both  eases  so  that  as  a»  n  ■*  • 

M  a*  M  +  n”^2  G  ,  » 

a i“1,a  C*  .  • 

The  eigenvalues  are  those  of  M  *“1^2  M .  e”1^2  which  by  (5.5)  are 

those  of 

M*~1/2  (Iq  -  f  1/2G*H*“1)(M  +  n“l/2C)(Iq  -  |  1/2M*“1C*)M* 

•  M*-1/2MM*-1/2  «f  m*”2^2CM*”2^2 

-  a  1/2m*_1/2g*m*"1km*"1/2 

-  ^  m*_1/2mk*_1g*m*"1/2 

If  we  eet  n  -  at,  m  ■  01  with  a,B  >  0  and  i  «►  •  (5.6)  has  the  form 

-1/2 

of  a  symmetric  fixed  matrix  plus  t  times  a  symmetric  Gaussian 
matrix  ao  that  the  earlier  thoery  is  applicable. 
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